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Method and system for providing personalized news 



This application claims the benefit of U.S. Provisional Application No. 
60/369,357, filed April 2, 2002. 



5 



The present invention relates generally to video content augmentation and, 
more particularly, to a method and system for providing personalized news. 



Several forms of personalized news services are currently available to 



10 consumers. For example, personalized web content is available on the Intemet from sources 
such as ABCNEWS.com and Yahoo. Using these systems, consumers may state specific 
preferences for types of news and have that news presented to them based on the content they 
have specified. However, these systems are generally limited to providing information to the 
consumer in a predetermined format and from a single source. 



personalized news are provided that substantially eliminate or reduce disadvantages and 
problems associated with conventional systems and methods. In particular, a consumer may 

20 receive news fi*om multiple sources in a single device, the news is prioritized for the 
consumer, and the news is provided to the consumer in any desired format. 

According to one embodiment of the present invention, a method for 
providing personalized news is provided. The method includes receiving news from a 
plurality of external sources. A subset of the received news is identified based on a consumer 

25 profile for the consumer. The identified news is stored. The stored news is prioritized. At 
least a portion of the prioritized news is provided to the consumer. 

According to another embodiment of the present invention, a system for 
providing personalized news is provided that includes a memory and a processor. The 
memory is operable to store user profile tables, profile data matching tables, an information 



15 



In accordance with the present invention, a method and system for providing 
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content matching table, and personalized news. The processor is operable to receive news 
from a plurality of extemal sources, to identify a subset of the received news based on a 
consumer profile for the consumer as stored in the user profile tables and the profile data 
matching tables, to store the identified news in the personalized news of the memory, to 
prioritize the stored news, and to provide at least a portion of the prioritized news to the 
consumer. 

Technical advantages of one or mdre embodiments of the present invention 
include providmg an improved method for providing personalized news to a consumer. In a 
particular embodiment, news from multiple sources, such as television, radio, the hitemet and 
tibie like, is identified for the consumer based on a consumer profile. In addition, that news is 
prioritized for the consumer based on the consumer's profile, broadcaster inq>ortance, and 
other suitable criteria. Content is also provided to the consumer m a single device using any 
one of multiple formats, such as video, audio and/or text, based on the consumer's 
preference. 

Other technical advantages will be readily apparent to one skilled m the art 
from the following figures, description, and claims. 

Before undertaking the DETAILED DESCRIPTION, it may be advantageous 
to set forth definitions of certain words and phrases used throughout this patent document: 
the terms "include" and "comprise," as well as derivatives thereof, mean inclusion without 
limitation; the term "or," is inclusive, meaning and/or; the phrases "associated with" and 
"associated therewith," as well as derivatives thereof may mean to include, be included 
within, interconnect with, contain, be contained within, connect to or with, couple to or with, 
be communicable with, cooperate with, interleave, juxt^se, be proximate to, be bound to or 
with, have, have a property of, or the like; and the term "controller" means any device, 
system or part thereof that controls at least one operation, such a device may be implemented 
in hardware, firmware or software, or some combination of at least two of the same. It should 
be noted that the ftmctionaUty associated with any particular controller may be centralized or 
distributed, whether locally or remotely. In particular, a controller may comprise one or more 
data processors, and associated input/output devices and memory, that execute one or more 
appUcation programs and/or an operating system program. Definitions for certain words and 
phrases are provided throughout this patent document, those of ordinary skill in the art should 
understand that in many, if not most instances, such definitions apply to prior, as well as 
fixture uses of such defined words and phrases. 
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For a more complete understanding of the present invention and its 
advantages, reference is now made to the following description taken in conjunction with the 
accompanying drawings, wherein like reference numerals represent like parts, in which: 

Fig. 1 is a block diagram illustrating a video display system operable to 
provide personalized news to a consumer in accordance with one embodiment of the present 

invention; ^ , ^ 

Fig. 2 is a block diagram illustrating the content augmentation application of 
Fig. 1 in accordance with one embodiment of the present invention; 

Figs. 3A-F illustrate the user profile tables of Fig. 2 in accordance with one 
embodiment of the present invention; 

Figs. 4A-C illustrate the profile data matching tables of Fig. 2 m accordance 
with one embodiment of the present invention; 

Fig. 5 illustrates the inforaiation content matching table of Fig. 2 in 
accordance with one embodiment of the present invention; 

Fig. 6 is a block diagram illustrating a summary screen that may be displayed 
by the video display system of Fig. 1 in accordance with one embodiment of the present 
invention; 

Fig. 7 is a block diagram illustrating a content zone screen that may be 
displayed by the video display system of Fig. 1 in accordance with one embodiment of the 
present invention; 

Fig. 8 is a block diagram illxistrating a content zone screen showing augmented 
stories that may be displayed by the video display system of Fig. 1 in accordance with one 
embodiment of the present invention; 

Fig. 9 is a block diagram illustrating a remote control layout for the remote 
control of Fig. 1 in accordance with one embodiment of the present invention; 

Fig. 10 is a flow diagram illustrating a method for providing personalized 
news to a consumer using the content augmentation application of Figs. 1 and 2 in 
accordance with one embodiment of the present invention; 

Figs. 1 1 A-F are screen shots illustrating complementary information screens 
that may be displayed by the video display system of Fig. 1 in accordance with several 
embodiments of the present invention; and 
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Fig. 12 is a flow diagram illustrating a mettiod for providing complementary 
information for a video program using the content augmentation application of Figs. 1 and 2 
in accordance Avith one embodiment of the present invention. 



Figs. 1 through 12, discussed below, and the various embodiments used to 
describe the principles of the present invention in this patent document are by way of 
illustration only and should not be construed in any way to limit the scope of the invention. In 
the desCTiption of the invention that follows, tiie present invention is integrated into, or is 
used in connection with, a television receiver. However, this embodiment is by way of 
example only and should not be construed to limit the scope of the present invention to 
television receivers. Thus, those skilled in the art will understand that the principles of the 
present invention may be implemented in any suitably arranged video display system. 

Fig. 1 is a block diagram illustrating a video display system 100 that is 
operable to provide personalized news to a consumer in accordance with one embodiment of 
the present invention. For the illustrated embodiment, the video display system 100 
comprises a content augmentation application 102 and a television receiver 104. Although 
the content augmentation ^plication 102 is illustrated as a separate component &om the 
television receiver 104, it will be understood that the content augmentation ^plication 102 
may be incorporated into the television receiver 104 without departing from the scope of the 
present invention. 

The content augmentation application 102 is operable to receive incoming 
video, audio, text and any other suitable signals from an external source, such as a cable 
television service provider, a local antenna, a satellite, the Intemet, a DVD player, a video 
cassette recorder, or the like. Thus, the incoming signals may be digital signals, analog 
signals, Intemet protocol (IP) packets, or any other suitable type of signals. 

The content augmentation application 102 is also operable to provide content 
to a consumer based on the received signals. For example, the content augmentation 
application 102 is operable to transmit television signals from a selected channel and/or radio 
signals from a selected station to the television receiver 104. A channel or station may be 
selected manually by the consumer, automatically by a recording device previously 
programmed by the consumer, or by any other suitable means. 

The content augmentation ^plication 102 is also operable to augment the 
content received from the external sources for the consumer. For example, as desaibed in 



wo 03/084230 ^^PCT/IB03/01375 

more detail below, the content augmentation application 102 is operable to personalize news 
content received from the external sources for a consumer, to provide complementary 
information related to the content when requested by the consumer, and to fiirther augment 
the content for use by the consumer in any suitable manner. 

The content augmentation appUcation 102 may comprise an infrared (IR) 
sensor 1 10 that is operable to receive commands from a remote control device 112 operated 
by the consumer. The content augmentation application 102 also comprises a user interface 
1 14 for providing personalized news and complementary information to the consumer. In 
order to accomplish this, the user interface 1 14 comprises a personalized news module 116 
and a complementary information module 118, as described in more detail below. The 
television receiver 104 may comprise a screen 120, an infrared (IR) sensor 122, and one or 
more manual controls 124. The IR sensor 122 is operable to receive commands from the 
remote control device 1 12 operated by the consumer. 

At least a portion of the personalized news module 116 and/or the 
complementary information module 118 may comprise logic encoded in media. The logic 
comprises ftinctional instructions for carrying out program tasks. The media comprises 
computer disks or other computer-readable media, application-specific integrated circuits, 
field-programmable gate arrays, digital signal processors, other suitable specific or general 
purpose processors, fransmission media or other suitable media in which logic may be 
encoded and utilized. Information module 118 may conform, for instance, to the teachings of 
U.S. Patent Publication No. 20020144293 entitled "AUTOMATIC VIDEO RETRIEVER 
GENIE" by N. Dimitrova et al and/or A. Janevski et al, "Enhanced Video Viewing From 
MetaData," Proceedings of the SPIE JTCom, August 2001. 

Fig. 2 is a block diagram illustrating the content augmentation application 102 
in accordance with one embodiment of the present invention. In addition to the IR sensor 110 
and the user interface 1 14, the content augmentation application 102 may comprise a 
controller 200, a processor 202, and any other suitable components (not illustrated in Fig. 2). 
A suitable implementation of processor 202 may be found, for example, in A. Janevski et al, 
"Web Information Extraction for Content Augmentation," Proceedings of IEEE ICME, 
August 2002. 

The controller 200 is operable to direct the overall operation of the content 
augmentation application 102. According to one embodiment, the controUer 200 is operable 
to cause an incoming signal to be processed by ttie processor 202 and transmitted to the 
television receiver 104 and/or the user interfece 1 14. For example, the controller 200 may be 
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operable to cause a television signal firom a cable service provider to be demodulated and 
processed by the processor 202 and transmitted to the television receiver 104 for viewing on 
the screen 120. As another example, the controller 200 may be operable to cause a news story 
from the Internet to be processed by the processor 202 and transmitted to the user interface 
1 14 for further processing by the personal news module 116. 

The processor 202 may comprise radio frequency (RF) front-end circuitry for 
receiving incoming television signals, tuning to a user-selected channel, and converting the 
selected RF signal to a baseband television signal suitable for display on the television 
receiver 104. The processor 202 is also operable to receive a conventional signal from an 
MPEG encoder/decoder and video frames from memory and to transmit a baseband 
television signal to the television receiver 104. In addition, the processor 202 may be 
operable to process video, audio, text and other suitable signals from other extemal sources, 
such as radio signals or signals from the Intemet. It will be vinderstood that the processor 202 
may comprise one or more processors for processing the different types of signals. 

The personalized news module 1 1 6 of the user interface 114 comprises a 
memory 210 and a processor 212. The memory 210 may comprise random access memory 
(RAM), a combination of RAM and read only memory (ROM), or any other suitable form of 
memory. According to one embodiment, the memory 210 may comprise a non-volatile RAM, 
such as flash memory. The memory 210 is operable to store a plurality of tables 214, 216 and 

218 and personalized news 219. The tables comprise user profile tables 214, profile data 
matching tables 216 and an information content matching table 21 8. The personalized news 

219 comprises news stories and other information that is identified and stored for the 
consumer based on the consumer's profile. The consumer's profile may include information 
relevant to the consumer as stored in the user profile tables 214 and the profile data matching 
tables 216. In addition, the memory 210 is operable to store mformation identifymg the 
format in which the consumer desires to receive news. 

The personalized news module 1 16 is operable to prioritize information for a 
consumer based on a personal profile of the consiraier, broadcaster importance, and other 
suitable criteria, as stored in the tables 214, 216 and/or 218, to provide content to the 
consumer from multiple sources, such as television, radio, the Intemet and the like, to 
provide content to the consumer in multiple formats, such as video, audio and/or text, and to 
provide personalized news for the consumer in any other suitable manner. 

In operation, according to one embodiment, information from a variety of 
sources may be provided to a consumer on a single device, such as a television set For 
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example, news stories from the Internet, radio stations, and broadcast or cable television 
channels may be provided to the consumer on the single device. 

In addition, the consumer may choose to receive the information in a variety 
of different fomiats, such as audio, visual and/or text. For those stories which are from a non- 
visual source, such as web stories, the personalized news module 116 generates a synthetic 
news anchor that "reads" the story to the consumer vsdien the consumer desires to receive the 
information in a visual foraiat The personalized hews module 116 may also generate a text 
story based on a television news story when the consumer desires to receive the infomiation 
in a text format Similarly, the personalized news modiile 116 may transform stories mto any 
format in which the consxmier desires to receive the information. 

The processor 212 of the personal news module 1 16 identifies those stories of 
interest to the consumer based on the user profile tables 214 and the profile data matching 
tables 216. After identifying these stories, the processor 212 stores the stories in the 
personalized news 219 of the personalized news module 116. The processor 212 also 
prioritizes the stories based on the infomiation content matching table 218 and presents the 
stories to the consumer when requested in the desired format. 

In addition, for one embodiment, the personal news module 116 may store 
data for a plurality of consumers in the memory 210. For this embodiment, each consumer 
may provide identifying information to the personal news module 116 when using the user 
interface 1 14 to receive personalized news for that consumer. 

The complementary information module 1 18 of the user interface 1 14 
comprises a memory 220 and a processor 222, It will be understood that the processors 212 
and 222 may be implemented in a single processor in the user interface 1 14 without departing 
from the scope of the present mvention. The memory 220 may comprise random access 
memory (RAM), a combination of RAM and read only memory (ROM), or any other suitable 
form of memory. According to one embodiment, the memory 220 may comprise a non- 
volatile RAM, such as flash memory. The memory 210 is operable to store user data tables 
224 and complementary information 226, as described in more detail below. 

The complementary information module 1 18 is operable to provide 
information that is complementary to a video program to a consvimer when that information 
is requested by the consumer. The complementary iirformation module 1 1 8 is operable to 
perform this task by anticipating the information that may be requested and storing such 
information m the complementary information 226 of the memory 220, as well as storing 
user data that is specific to the consumer in the user data tables 224. In an alternative 
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embodiment, the complementary infomiation may be retrieved by the processor 222 from the 
video program itself as it is received from an external source. 

For one embodiment, the complementary information module 1 1 8 is operable 
to provide a visual indicator to notify the consumer that complementary infomiation is 

5 available upon request. For example, a may notify the consxmier that "how much" 
information is available and a ' V" may notify the consumer that 'Svho" information is 
available. It will be understood that the visxial indicators may comprise any suitable form 
witiiout departing from the scope of the present invention. 

The data stored in the user data tables 224 may comprise data identifying 

1 0 video programs that have been previously viewed by a consumer. This data may be stored 
automatically by the processor 222 when a video program is played and/or may be stored 
manvially by the consumer. In addition, for one embodiment, the user data tables 224 may 
store such data for a plurality of consumers. For this embodiment, each consumer may 
provide identifying infomiation to the complementary information module 118 when using 

15 the user interface 1 14 to receive complementary information for a video program and/or to 
allow the complementary information module 1 1 8 to store the relevant user data in the user 
data tables 224 for that consumer. 

The complementary information module 118 is also operable to synchronize 
complementary infomiation 226 and a video program for the consumer, to provide control 

20 over access and navigation of the complementary information 226 to the consumer, to update 
the complementary information 226, and to provide complementary information 226 to the 
consumer by any other suitable means. 

In operation, according to one embodiment, the complementary information 
module 118 may receive queries from consumers, such as **who queries," '•what queries," 

25 "where queries," "when queries," "why queries," "how much queries," and/or any other 
suitable queries. The complementary information module 118 may then predict what 
information the consumer desires and access the complementary information 226 in order to 
retrieve that information. If the information provided by the complementary mformation 
module 1 18 is not the information that the consumer desired, the consumer may submit an 

30 additional query until the correct information is provided by the complementary information 
module 1 18. In an alternative embodiment, the consumer may specify what information he or 
she desires based on options provided by the complementary information module 118. 

For one embodiment, the consumer may select an option that directs the 
complementary information module 11 8 to provide all the complementary information 226 
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for a particular video program or to provide specified subsets of the complementary 
iiifomiadon 226 for the video program. 

Several options may be used in order to include complementary information 
with a video program that may be retrieved by the processor 222 and/or stored in tiie 
complementary information 226 of the complementary information module 1 18. A first 
option involves the creators of the video program aimotating the video program during the 
creation process. 

For a second option, the processor 222 may process and analyze the video 
program to extract complementary information. For example, optical character recognition 
technology may be used to read the credits and leam that a certain actor plays a character 
named Fred. Then, the processor 222 may analyze the visual, audio and transcript data for 
references to Fred and infer which onscreen character corresponds to Fred. The processor 222 
may then leam to recognize the face and voice of tiie actor playing the part of Fred. Face 
recognition and voice identification for automatic person identification can be xised for this 
pxirpose (see: Dongge Li, Gang Wei, Ishwar K. Sethi, and Nevenka Dimitrova, Person 
Identification in TV Shows, Journal on Electronic Imaging, special issue on Storage, 
Processing and Retrieval of Digital Media, October 2001). 

A third option may combine the first and second options. For this option, the 
creators of the video program may insert any pertinent information they wish to include as 
complementary information, while the processor 222 may be able to analyze the video 
program in order to provide additional complementary information. For example, if a 
consumer requests information on an object in a scene, such as a wineglass, that is not 
included by the creators, the processor 222 may attempt to recognize the object and seek 
information about the object from the Intemet or other suitable external data sources. 

The complementary information module 118 may use at least two methods in 
order to update complementary hiformation for a video program. First, the processor 222 
may analyze the complementary information provided with the video program in order to 
determine how much time has passed since the complementary information was inserted or 
updated. If a predetermined amount of time has passed, the processor 222 may attempt to 
retrieve more updated information from external data sources and to store any such retrieved 
information as complementary information 226 for that video program. 

Second, if the video program is being broadcast after a predetermined amount 
of time has passed since the complementary information was inserted or updated, the 
broadcasters may update the complementary information before the broadcast. In addition. 
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local broadcasters may provide location-specific complementary information based on cities, 
zip codes, and the Uke for the area which will receive tiie broadcast. 

In order to access the complementary information for a video program, 
consumers may use one of at least three different options. First, the consumer may generate a 
query, such as a "who query," a "what query," a 'Svhere query," a "when query," a 'Svhy 
query," a "how much query," and/or any other smtable query. According to one embodiment, 
the **who query" may comprise one or more of filinography, biography and rumors for an 
actor. The "how much" query may be provided in accordance with the principles described in 
the U.S. Patent AppUcation entitled "A System for and Method of Shopping Through 
Televisions," by N. Dimitrova, J. Zimmerman, and R. Jasinschi (Attorney docket no. 
702359) which was filed on December 1 1, 200L 

The complementary information module 118 may then predict what 
information the consumer desires and access the complementary information in order to 
retrieve that mformation. If the information provided by the complementary uxFormation 
module 1 1 8 is not the information that the consumer desured, the consimier may submit an 
additional query imtil the correct information is provided by the complementary information 
module 118. 

Second, the consxmier may select an option that directs the complementary 
information module 1 18 to provide all the complementary mformation for a particular video 
program or to provide one or more specified subsets of the complementary information for 
the video program, such as actors' names, director's comments, or the like. 

Third, the consumer may request that the complementary information be sent 
to a secondary screen, such as a personal digital assistant, a touch-screen remote control, a 
web pad, a mobile phone, or the like. For this option, the information provided to the 
secondary screen may be generated in accordance with either the first or second option or by 
any other suitable process. 

Using the complementary information module 1 1 8, the user interface 1 14 may 
allow consumers to receive a variety of types of complementary information while viewmg a 
video program. For example, a consumer may be watching a movie and recognize an actress 
but be unable to remember her name. The complementary information module 118 may 
provide this information to the consumer, along with telling the consumer which previous 
video programs the consumer has seen with that same actress based on the data in the user 
data tables 224. As another example, while viewing a soccer game, a consumer may select a 
particular player and receive statistics and other relevant information about that player from 
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the complementary inforaiation module 118. Also, if a consumer is viewing a video program 
and sees an item that he or she would like to purchase, such as the shoes a particular 
character is wearing, the cousumer may receive from the complementary inforaiation module 
118 information such as a price and/or the name of a local retail outlet at which the item may 
be purchased. For one embodiment, the scene may be bookmarked by the consumer such that 
he or she may retum at a more convenient time to receive the information. For this 
embodiment, any complementary information desired by the consumer may be identified by 
the consimier as delayed complementary information. This delayed complementary 
information may be viewed by the consumer at any later time, such as at the end of the video 
program. 

Figs. 3 A-F illustrate the user profile tables 214 in accordance with one 
embodiment of the present invention. Although they are illustrated and discussed in table 
format, it will be understood that the user profile tables 214 may comprise any suitable data 
store operable to store the relevant information in any suitable manner. 

Fig. 3 A illustrates a personal profile table 300 that is operable to store personal 
data related to the consimier. For the illustrated embodiment, the personal profile table 300 
comprises a name, a home address and a work address for the consumer. However, it will be 
understood that the personal profile table 300 may comprise any suitable personal data for the 
consumer without departing fi:om the scope of the present invention. 

Fig. 3B illustrates a traffic route table 310 that is operable to store traffic data 
related to the consumer. For the illustrated embodiment, the traffic route table 310 comprises 
a plurality of routes from the consumer's home to various destinations, including work. Each 
route (given in the left colunm) comprises an identification of the major roads over which the 
consumer typically travels to reach the corresponding destination (right column). It will be 
understood that the traffic route table 310 may comprise any suitable traffic data for the 
consumer without departing from the scope of the present invention. 

Fig. 3C illustrates a traffic hot spot table 320 that is operable to store 
additional traffic data related to the consumer. For the illustrated embodiment, the traffic hot 
spot table 320 comprises a Usting of the major roads over which the consumer typically 
travels. However, it will be understood that the traffic hot spot table 320 may comprise any 
suitable additional traffic data for the consumer without departing from the scope of the 
present invention. In addition, it will be understood that the traffic route table 3 1 0 and the 
traffic hot spot table 320 may be consolidated into a single traffic table without departing 
from the scope of the present invention. 
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Fig. 3D illustrates a financial table 330 that is operable to store financial data 
related to the consumer. For the illustrated embodiment, the financial table 330 comprises 
three columns: an identifying symbol, a type indicator, such as index, stock or mutual fund, 
and an entity name for each of a plurality of entities in which the consumer has an interest, 
5 financially or otherwise. However, it will be understood that the financial table 330 may 

comprise any suitable financial data for the consimier without departing from the scope of the 
present invention. 

Fig. 3E illustrates a sports table 340 that is operable to store sports data for the 
consumer. For the illustrated embodiment, the sports table 340 comprises two columns: a 

1 0 sport name and a team name for each of a plurality of sports teams in which the consumer has 
an interest. However, it will be understood that the sports table 340 may comprise any 
suitable sports data without departing from the scope of the present invention. 

Fig. 3F illustrates a headline table 350 that is operable to store headline data 
for the consmner. For the illustrated embodiment, the headline table 350 comprises 

15 participants 352, locations 354 and keywords 356. However, it will be understood that the 
headline table 350 may comprise any suitable headline data for the consumer without 
departing firom the scope of the present invention. 

For the illustrated embodiment, the participants 352 comprise a plurality of 
potential participants in news stories in which the consxraier has an interest. For this 

20 embodiment, the participants 352 may refer to other user profile tables 214, such as the sports 
table 340 (all tracked sports teams), the financial table 330 (all tracked companies - stock), or 
the like, in order to identify the participants. In addition, specific participants, such as China, 
Bush, or the like, may be identified. The locations 354 comprise a plurality of potential 
locations firom which news stories may originate or to which news stories may be relevant 

25 Shnilarly, the keywords 356 comprise a plurality of topics or keywords that may appear in 
news stories of interest to the consumer. 

Figs. 4A-C illustrate the profile data matching tables 216 in accordance with 
one embodiment of the present invention. Although they are illustrated and discussed in table 
format, it will be understood that the profile data matching tables 216 may comprise any 

30 suitable data store operable to store the relevant information in any suitable maimer. 

Fig. 4A illustrates a local events table 400 that is operable to store 
prioritization data for local events for the consumer. For the illustrated embodiment, the local 
events table 400 provides for prioritizing local events based on a match to the consumer's 
profile, the distance of the event firom the consumer's home, and an amount of time 
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remaining until the event occurs. However, it will be understood that the local events table 
400 may provide for prioritizing local events based on any suitable criteria without departing 
from the scope of the present invention. According to one embodiment, the consumer may 
specify the percentages associated with each criterion in the local events table 400. In 
5 addition, according to one embodiment, the criteria themselves may be selected by the 
consmner. Alternatively, the percentages and/or the criteria may be predetermined. 

Fig. 4B illustrates a headline table 410 that is operable to store prioritization 
data for headlines for the consumer. For the illustrated embodiment, the headline table 410 
provides for prioritizing headlines based on a match to the consumer's profile, broadcaster 

10 importance, as described in more detail below in connection with Fig. 5, and how current the 
headline is. However, it will be understood that the headline table 410 may provide for 
prioritizing headlines based on any suitable criteria without departing from the scope of the 
present invention. According to one embodiment, the consumer may specify the percentages 
associated with each criterion in the headline table 410. In addition, according to one 

15 embodiment, the criteria themselves may be selected by the consimier. Alternatively, the 
percentages and/or the criteria may be predetermined. 

Fig. 4C illustrates a story table 420 that is operable to store prioritization data 
for stories other than headlines for the consumer. For the illustrated embodiment, the story 
table 420 provides for prioritizing stories other than headlines based on a match to the 

20 consumer's profile, broadcaster importance, as described in more detail below in connection 
with Fig. 5, and an amount of time since or until the occurrence of an event associated with 
the story. However, it will be understood that the story table 420 may provide for prioritizing 
stories based on any suitable criteria without departing from the scope of tihie present 
invention. According to one embodiment, the consumer may specify the percentages 

25 associated with each criterion in the story table 420. In addition, according to one 

embodiment, the criteria themselves may be selected by the consumer. Alternatively, tiie 
percentages and/or the criteria may be predetermined. 

Fig. 5 illustrates the information content matching table 218 in accordance 
with one embodiment of the present invention. Although they are illustrated and discussed in 

30 table format, it will be xmderstood that the information content matching table 218 may 
comprise any suitable data store operable to store the relevant information in any suitable 
manner. 

The information content matching table 218 is operable to store data related to 
prioritization of news for the consumer. For tiie illustrated embodiment, the information 
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content matching table 218 comprises broadcaster importance, story depth, and novelty. 
However, it wiU be understood that the inforaiation content matching table 218 may 
comprise any suitable prioritization data without departing from the scope of the present 
invention. 

Broadcaster importance is a relative measure of the importance of a news story 
based on length, position within a broadcast or on a web page, or other suitable criteria. Story 
depth is an absolute measure of the importance of a news story based on length, new 
information of substance, quality of the reportage, such as who is interviewed and whether 
there is relevant action in the reportage, or other suitable criteria. Novelty is a measure of the 
overall novelty of the mfomiation within a news story based whether the story relates to a 
new event, is an update of an earlier story or is a continuing story about an earlier event. 

According to the illustrated embodiment, the relative importance of 
broadcaster importance and novelty combine to 100%, while the story depth may comprise a 
binary filter of shallow or deep. However, it will be understood that these criteria may be 
otherwise weighted (for example, all of them can be binary filters or can have explicit 
numeric values) without departing from the scope of the present invention. 

For one embodiment, the broadcaster importance may comprise a match to 
rank ordered stories and an ampUfication-based weighted measure, with the top stories 
receiving the heaviest matching. The story depth may comprise a match to select which story 
to present based on the binary filter. With clustered stories, only one story may be presented, 
with the consumer able to request the additional stories. The novelty may comprise a match 
to select the novel stories and follow up on ongoing stories. 

Fig. 6 is a block diagram illustrating a summary screen 600 that may be 
displayed by the video display system 100 in accordance with a fibrst embodiment of the 
present invention. The sxmmiary screen 600 comprises a banner 602 and a plurality of content 
zone summaries 604, 606, 608, 610, 612 and 614. The banner 602 may indicate the logo of 
the service provider, tibie number of stories found in each of the content zones, the total 
duration of those stories, and a current date and time. 

Although the illustrated embodiment comprises six content zone simmiaries 
604, 606, 608, 610, 612 and 614 with six corresponding content zones, it will be understood 
that any suitable number of any suitable type of content zone may be provided without 
departing from the scope of the present invention. The content zone summaries 604, 606, 
608, 610, 612 and 614 comprise summaries of the information available in each of the 
corresponding content zones. For the illustrated embodunent, the content zone summaries 
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comprise a weather zone 604, a traffic zone 606, a financial zone 608, a headline zone 610, a 
local event zone 612, and a sports zone 614. 

While viewing the summary screen 600, a consumer may select one of the 
content zones in order to view a content zone screen with additional details and stories, direct 
5 the content augmentation application 102 to play all news stories in a particular content zone, 
direct the content augmentation application 102 to play all news stories in all content zones, 
direct the content augmentation application 102 16 play selected stories firom all content 
zones and/or select any other smtable task for the content augmentation application 102 to 
perform. 

10 Fig, 7 is a block diagram illustrating a content zone screen 700 that may be 

displayed by the video display system 100 in accordance with one embodiment of the present 
invention. For this embodiment, the content augmentation application 102 begins to play 
news stories when the zone summary screen 700 is selected for display by the consimier. 
Based on the consimier's profile, the content augmentation application 102 places the content 

15 zones in a particular order for playback. 

The content zone that comprises the news stories currently being played, or the 
expanded content zone, is identified by a content zone label 702, and the stories for that 
content zone are played in an expanded zone 704. Altematively, the content zone may be 
identified by a specific background pattern, with specific texture and/or animation. A chamiel 

20 label 706 identifies the source of the news story currently being played in the expanded zone 
704, and the placement of the news story within that source is identified by a placement bar 
708. The duration of the news story, as well as the elapsed time, is provided in a duration bar 
710. An additional information section 712 may also identify the position of the story relative 
to the total number of stories for the expanded content zone, the status of the currently 

25 playing story, such as selected, new, seen, partially seen, saved, and the like, and any other 
relevant information. 

A collapsed content zone section 720 comprises an identifier, a summary, or 
other suitable information corresponding to each of the content zones other thaa the 
expanded content zone. These collapsed content zones may be listed in the order in which 

30 they will be selected for playback based on the consumer's profile. Thus, as the news stories 
for each expanded content zone are completed, the e3q)anded content zone may be moved to 
the bottom of the collapsed content zone section 720 and the content zone at the top of the 
collapsed content zone section 720 may become the next expanded content zone. 
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At any time during the playback of a story, the consumer may also select a full 
screen option, which causes the story to be played using the full screen 120. Thus, the 
coUapsed content zone section 720, as well as the channel label 706, the placement bar 708, 
the duration bar 710, and the additional information section 712, may be hidden, allowing the 

5 expanded zone 704 to fill the entire screen 120. It will be imderstood that the fiill screen 
option may be modified to include allow the display of any of the channel label 706, the 
placement bar 708, the duration bar 710, and the additional information section 712 along 
with the expanded zone 704 without departing from the scope of the present invention. 

Fig- 8 is a block diagram illustrating a content zone screen 800 that may be 

10 displayed by the video display system 100 in accordance with one embodiment of the present 
invention. A consumer may select a particular content zone from a summary screen, such as 
the summary screen 600 or 700. The selected content zone is identified by a content zone 
label 802. Alternatively, the content zone may be identified by a specific background pattern, 
with specific texture and/or animation. 

15 If a consumer directs the content augmentation application 102 to play all the 

news stories for the content zone, the stories for that content zone are played in an expanded 
zone 804. A channel label 806 identifies the source of the news story currently being played 
in the expanded zone 804, and the placement of the news story within that source is identified 
by a placement bar 808. The duration of the news story, as well as the elapsed time, is 

20 provided in a duration bar 810. An additional information section 812 may also identify the 
position of the story relative to the total number of stories for the selected content zone, the 
status of the currentiy playing story, such as selected, new, seen, partially seen, saved, and 
the like, and any other relevant information. 

A collapsed story section 820 comprises an identifier, a summary, or other 

25 suitable information corresponding to each of the stories other than the currentiy playing 
story. These collapsed stories may be prioritized in accordance with the data stored in the 
information content matching table 218, as described in more detail above in connection with 
Fig. 5. Thus, as each news story is completed, that story may be moved to the bottom of the 
collapsed story section 820 and the story at the top of the collapsed story section 820 may 

30 become the next expanded story to be played in the expanded zone 804. In addition, the 

consumer may manually select any one of the stories from the collapsed story section 820 for 
playback at any time. 

At any time during the playback of a story, the consumer may also select a full 
screen option, which causes the story to be played using the fiiU screen 120. Thus, the 



wo 03/084230 j|^CT/IB03/0137S 

W W 

cx>llapsed story section 820, as well as the channel label 806, the placement bar 808, the 
dxiration bar 810, and the additional information section 812, may be hidden, allowing the 
expanded zone 804 to fill the entire screen 120. It will be understood that tiie full screen 
option may be modified to include allow the display of any of the channel label 806, the 

5 placement bar 808, the duration bar 810, and the additional information section 812 along 
with the expanded zone 804 without departing from the scope of the present invention. 

The content zone screen 800 coinpirises a clustered story button 824 that is 
operable to identify a story that has been augmented with additional information from the 
Internet, from other television channels, or the like, after the original story was posted or 

10 broadcast. By selecting a story identified by a clustered story button 824, the consumer may 
see this additional information. It will be understood that the position of the visual elements 
in the content zone screen 800 may be flexible and may be configurable by the consumer. 

Fig. 9 is a block diagram illustrating a remote control layout 900 for the 
remote control 1 12 in accordance with one embodiment of the present invention. For this 

15 embodiment, the remote control 112 may allow a consumer to operate the personal news 

module 116 of the content augmentation application 102. The layout 900 may comprise two 
screens: a zones screen 902 and an action screen 904, It will be understood that the layout 
900 may comprise a single screen or more than two screens without departing from the scope 
of the present invention. 

20 The zones screen 902 comprises an action button 906, a weather button 908, a 

traffic button 910, a financial button 912, a sports button 914, an events button 916, and a 
headlines button 918. The action button 906 transitions to the summary screen 600 or 700 
and transitions to the action screen 904. The weather button 908, the traffic button 910, the 
financial button 912, the sports button 914, the events button 916, and the headlines button 

25 918 transition to the corresponding content zone screen 800. 

The action screen 904 comprises a zones button 920, an info button 922, a 
play/pause button 924, a previous button 926, a next button 928, a play all button 930, a 
screen button 932, a profiles button 934, and a reset button 936. The zones button 920 
transitions to the zones screen 902. The info button 922 extracts or contracts clustered stories 

30 for a selected story on a content zone screen 800. The play/pause button 924 toggles the story 
being played between play and pause. 

The previous button 926 skips to the previous story. The next button 928 skips 
to the next story. When the previous button 926 or the next button 928 is pressed by the 
consumer, the previous or next story, respectively, starts playing automatically. The play all 
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button 930 plays all news stories for a content zone or, from the summary screen 600, for all 
content zones. Thxxs, all news stories are strung together to form a personalized television 
show. For one embodiment, all the news stories may be played back from the summary 
screen 600 based on absolute priority regardless of the content zones. 

The screen button 932 toggles between a ftiU screen option and a summary or 
content zone screen 600, 700 or 800. The profiles button 934 toggles between a traffic profile 
and the traffic content zone. The reset button 936 returns all values to default values and 
starts a demonstration from the be ginn i ng . 

Fig. 10 is a flow diagram illustrating a method for providing p^sonalized 
news to a consumer using the content augmentation application 102 in accordance with one 
embodiment of the present invention. The method begins at step 1000 where the content 
augmentation application 102 receives news from external sources, such as a cable television 
service provider, a local antenna, a satellite, the Internet, a DVD player, a video cassette 
recorder, or the like. The news may comprise news stories and other newsworthy 
information, such as weather and traffic related information. 

At step 1002, the processor 212 of the personal news module 116 identifies a 
subset of the received news for the consumer based on the consumer's profile. At step 1004, 
the processor 212 stores the identified news in the personalized news 219. 

At step 1006, the content augmentation application 102 receives an activation 
request from the consumer. For example, the consumer may press a button on the remote 
control 1 12 in order to send the activation request to the infrared sensor 1 10 of the content 
augmentation application 102, The activation request comprises a request for the content 
augmentation application 102 to provide the news stored m the personalized news 219 to the 
consumer. 

At step 1008, the processor 212 prioritizes the news stored in the personalized 
news 219 based on data stored in the information content matching table 218. At step 1010, 
the personal news module 1 16 provides a summary screen 600 or 700 to the consumer. 

At decisional step 1012, a determination is made regarding whether or not the 
consumer has requested to view a particular content zone. If the consmner has not requested 
to view a particular content zone, the method follows the No branch from decisional step 
1012 and returns to step 1000 where the content augmentation application 102 continues to 
receive news from external sources. Thus, the content augmentation application 102 may 
receive news twenty-four hours a day, seven days a week. However, if the consumer has 
requested to view a particular content zone, the method follows the Yes branch from 
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decisional step 1 012 to step 1 014. At step 1014, the personal news module 116 provides the 
requested content zone screen 800 to the consximer. 

At decisional step 1016, a determination is made regarding whether or not the 
consumer has requested to view another content zone. If the consimier has requested to view 
5 another content zone, the method follows the Yes branch from decisional step 1016 and 
returns to step 1014, where the personal news module 1 16 provides the requested content 
zone screen 800 to the consumer. However, if the consumer has not requested to view 
another content zone, the method follows the No branch from decisional step 1016 to 
decisional step 1018. 

10 At decisional step 1018, a determination is made regarding wheflier or not the 

consumer has requested to view the smnmary screen 600 or 700. If the consumer has 
requested to view the summary screen 600 or 700, the method follows the Yes branch from 
decisional step 1018 and retums to step 1010, where the personal news module 116 provides 
the sxmmiary screen 600 or 700 to the consumer. However, if the consumer has not requested 

15 to view the summary screen 600 or 700, the method follows the No branch from decisional 
step 1018 and retums to step 1000 where the content augmentation application 102 continues 
to receive news from external sources. 

Figs. 1 1 A-F are screen shots illustrating complementary information screens 
1 lOOa-f that may be displayed by the video display system 100 in accordance with several 

20 embodiments of the present invention. Fig. 1 1 A comprises a complementary information 

screen 1 1 00a that illustrates one embodiment of a complementary information display 1 1 02a 
that may be displayed by liie complementary information module 1 18 in response to a 'Svhat 
query" from a consumer. In this example, the complementary information module 118 
predicts that the consumer is requesting information on the gun. As described in more detail 

25 above in connection with Fig. 2, the consiuner may initiate a subsequent '*what query" if the 
gun is not the object about which the consumer desires more information. 

Fig. 1 IB comprises a complementary information screen 1 100b that illustrates 
a first embodiment of a complementary information display 1 1 02b that may be displayed by 
the complementary information module 1 18 in response to a "who query" from a consumer. 

30 In this example, the complementary information module 118 predicts that the consumer is 

requesting information about the actress in flie foregroxmd. As described in more detail above 
in connection with Fig. 2, the consiuner may initiate a subsequent "who query" if flie 
consumer desired information about the actor in tiie backgromd instead. 
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Fig. lie comprises a complementary information screen 1 100c that illustrates 
a second embodiment of a complementary information display 1 102c that may be displayed 
by the complementary information module 1 18 in response to a '^vho query" jfrom a 
consumer. In this example, the complementary information module 118 predicts that the 

5 consumer is requesting information about the actress. As described in more detail above in 
connection with Fig. 2, the consumer may initiate a subsequent 'Svho query" if the consumer 
desired infomiation about the actor instead. 

Fig. 1 ID comprises a complementary information screen 1 lOOd that illustrates 
a third embodiment of a complementary information display 1 102d that may be displayed by 

10 the complementary information module 1 1 8 in response to a ''who query" from a consumer. 
In this example, the complementary information module 118 allows the consumer to select a 
particular actor from a plurality of une^es 1 104. In addition, for this embodiment, the 
consumer may select from at least two information options 1 106, such as "movies" and 
"rumors" and the like, to view a particular type of information related to the selected actor. 

15 Fig. 1 IE comprises a complementary information screen 1 lOOe that illustrates 

one embodiment of detailed complementary information that may be displayed by the 
complementary information module 1 18. In this embodiment, the complementary 
information module 118 allows the consumer to select from at least two query options 1 108, 
such as "music," "cast," "location" and the like, to view additional information and/or 

20 options for selection. 

For example, in the illustrated embodiment, the consumer has first selected the 
"cast" query option 1 108, causing the complementary information module 1 1 8 to provide a 
plurality of images 1 1 10 of cast members from which the consumer may select. The 
consumer has then selected the first cast member, Shirley Appleby, causing the 

25 complementary information module 1 18 to provide information about Shirley Appleby to the 
consumer in a complementary information display 1 102e. Also, for the illustrated 
embodiment, the complementary information display 1 102e indicates to the consumer by 
highlighting that the consumer has seen Shirley Appleby playing the role of Bridget Manilla 
in the movie, "The Thirteenth Floor." This information may be retrieved by the 

30 complementary information module 118 from the user data tables 224. 

Fig. 1 IF comprises a complementary information screen 1 lOOf that illustrates 
another embodiment of detailed complementary information that may be displayed by the 
complementary information module 1 1 8. In this embodiment, the complementary 
information module 118 allows the consumer to select from at least two query options 1112, 
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such as "location" "clothes," "music," "cast," and the like, to view additional information 
and/or options for selection. 

For example, in the illustrated embodiment, the consxuner has first selected the 
"music" query option 1 1 12, caxising the complementary information module 1 18 to provide a 
5 plurality of images 1114 of recordings containing songs played in the corresponding video 
program from which the consumer may select. The consvimer has then selected the first song. 
Dido's "Here With Me," causing the complemen^Eary information module 1 18 to provide 
information about the recording "No Angel," on which the song "Here With Me" appears, in 
a complementary information display 1 102f. It will be understood that the position of the 
10 visual elements in the complementary information screens 1 100 may be flexible and may be 
configurable by the consumer. 

Fig. 12 is a flow diagram illustrating a method for providing complementary 
information for a video program using tiie content augmentation application 102 in 
accordance with one embodiment of the present invention. The method begins at step 1200 
15 where the complementary information module 118 receives complementary information 
regardiug a video program. The complementary information may be received directly firom 
the video program and/or retrieved from the complementary information 226 in the memory 
220 of the complementary information module 118. 

At decisional step 1202, a determination is made regarding whether or not the 
20 complementary information needs to be updated. According to one embodiment, this 

detemiination is made based on vs^iether or not a predetermined amount of time has passed 
since the complementary information was inserted or updated in the video program. If the 
complementary information needs to be updated, the method follows the Yes branch from 
decisional step 1202 to step 1204. At step 1204, Ihe complementary information module 118 
25 attempts to retrieve updated information from external data sources and to store any such 
retrieved information as complementary information 226 for that video program. 

Returning to decisional step 1202, if the complementary information does not 
need to be updated, the method follows the No branch from decisional step 1202 to step 
1206. Also, from step 1204, the method continues to step 1206. At step 1206, the 
30 complementary information module 118 receives a query from a consimaer. The query may 
comprise a "what query," a "who query," a "music query," or any other suitable type of 
query operable to indicate to the complementary information module 118 what type of 
information the consumer desires to receive. The music query can be a query by humming. 
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by matching the musical phrase in the movie to all known songs, or by any other suitable 
method. 

At step 1208, the complementary information module 118 provides a query 
response to the consumer. In providing this response, the complementary inforaiation modxile 
5 118 may access the user data tables 224 in order to include any consumer-specific data 
relevant to the response. For example, if the query is a "who query," the complementary 
mformation module 118 may access the user data tables 224 in order to deteraiine what, if 
any, video programs the consiuner has previously seen with the same actor that is identified 
by the complementary information module 1 18 in the query response. 

10 At decisional step 1210, a determination is made regarding whether or not an 

additional query has been received fi-om the consumer. If an additional query has been 
received from the consumer, the method follows the Yes branch firom decisional step 1210 
and returns to step 1208, where the complementary information module 118 provides a query 
response to the consxraier. However, if no additional query has been received from the 

15 consumer, the method follows the No branch from decisional step 1210 and comes to an end. 

Although the present invention has been described with several embodiments, 
various changes and modifications may be suggested to one skilled in the art. It is intended 
that the present invention encompass such changes and modifications as fall within the scope 
of the appended claims. 
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CLAIMS: 



1 ^ A method for providing personalized news to a consvimer, comprising: 

receiving news from a plurality, of external sources; 

identifying a subset of the received news based on a consmner profile for the 

consiimer; 

5 storing the identified news; 

prioritizing the stored news; 

providing at least a portion of the prioritized news to the consumer. 

2, The method of claim 1 , receiving news from a plurality of extemal sources 
1 0 comprising receiving news from the extemal sources in a plurality of formats. 

3 , The method of claim 1 , providing at least a portion of the prioritized news to 
the consumer comprising providing at least a portion of the prioritized news in a format 
specified by the consumer. 

15 

4, The method of claim 1 , prioritizing the stored news is performed based on data 
stored in an information content matching table. 

5, The method of claim 4, the data stored in the information content matching 
20 table comprising broadcaster importance data, story depth data, and novelty data. 

6, The method of claim 1 , further comprising: 
receiving an activation request from the consumer; 

providing a summary screen to the consxmaer based on the activation request; 
25 receiving a request for a specified content zone from the consumer; and 

providing a content zone screen to the consumer based on the specified 



content zone. 
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7. The mefhod of claim 6, the content zone screen comprising one of a weather 

content zone screen, a traffic content zone screen, a financial content zone screen, a sports 
content zone screen, a local events content zone screen and a headlines content zone screen. 

5 8. The method of claim 7, further comprising providing a visual indicator to 

notify the consumer of which content zone is currently active. 

9. The method of claim 8, wherein the visual indicator comprises one of a 
specific background pattern, a specific texture, and animation. 

10 

10. The method of claim 6, visual elements of the content zone screen 
configurable by the consumer. 



1 1 . The method of claim 6, fiorther comprising: 

1 5 receiving a request for a zone summary screen firom the consumer; and 

providing the zone summary screen to the consimier. 

12. The method of claim 6, the content zone screen comprising an expanded zone 
and a collapsed content zone section. 

20 

13. The method of claim 6, fiirther comprising: 

receiving a previous selection on the content zone screen; and 
automatically playing a previous story based on the previous selection. 



25 14, The method of claim 6, further comprising: 

receiving a next selection on the content zone screen; and 
automatically playing a next story based on the next selection. 



15. The method of claim 6, further comprising: 

30 receiving a play all selection on the summary screen or the content zone 

screen; and 

playing all news stories for the summary screen or the content zone based on 
the play all selection. 
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16. The metibod of claim 13, further comprising playing all news stories for fhe 
summary screen based on absolute priority. 

17. The method of claim 6, further comprising: 

providing a clustered story button on the content zone screen, the clustered 
story button operable to identify a story augmented with additional information; 

. , receiving a selection of the cluslerfed story button from fhe consumer; and 
providing the additional information to fhe consimier based on the selection of 
the clustered story button. 



18. A system for providing personalized news to a consumer, comprising: 

a memory operable to store user profile tables, profile data matching tables, an 
information content matching table, and personalized news; and 

a processor operable to receive news from a plurality of external sources, to 
identify a subset of fhe received news based on a consxmier profile for the consumer as stored 
in the user profile tables and the profile data matching tables, to store the identified news in 
the personalized news of the memory, to prioritize the stored news, and to provide at least a 
portion of the prioritized news to the consumer. 

1 9. The system of claim 1 8, wherein fhe processor is operable to prioritize the 
stored news based on data stored in fhe information content matching table. 

20. The system of claim 1 8, the processor further operable to receive an activation 
request from fhe consumer, to provide a summary screen to fhe consumer based on fhe 
activation request, to receive a request for a specified content zone from the consumer, and to 
provide a content zone screen to fhe consumer based on fhe specified content zone. 

21 . A system for providing personalized news to a consumer, comprising: 
a computer-processable medium; and 

logic stored on the computer-processable medium, the logic operable to 
receive news from a plurality of external sources, to identify a subset of the received news 
based on a consumer profile for fhe consumer, to store the identified news, to prioritize the 
stored news, and to provide at least a portion of fhe prioritized news to fhe consumer. 
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